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Abstract 

The 3DVAR filter is prototypical of methods used to combine observed 

data with a dynamical system, online, in order to improve estimation of 
the state of the system. Such methods are used for high dimensional 
data assimilation problems, such as those arising in weather forecasting. 
To gain understanding of filters in applications such as these, it is hence 
of interest to study their behaviour when applied to infinite dimensional 
dynamical systems. This motivates study of the problem of accuracy and 
stability of 3DVAR filters for the Navier-Stokes equation. 

We work in the limit of high frequency observations and derive contin- 
uous time filters. This leads to a stochastic partial differential equation 
(SPDE) for state estimation, in the form of a damped-driven Navier- 
Stokcs equation, with mean-reversion to the signal, and spatially-correlated 
time-white noise. Both forward and puUback accuracy and stability re- 
sults are proved for this SPDE, showing in particular that when enough 
low Fourier modes are observed, and when the model uncertainty is larger 
than the data uncertainty in these modes (variance inflation), then the 
filter can lock on to a small neighbourhood of the true signal, recovering 
from order one initial error, if the error in the observations modes is small. 
Numerical examples are given to illustrate the theory. 

1 Introduction 

Data assimilation is the problem of estimating the state variables of a dynamical 
system, given observations of the output variables. It is a challenging and funda- 
mental problem area, of importance in a wide range of applications. A natural 
framework for approaching such problems is that of Bayesian statistics, since 
it is often the case that the underlying model and/or the data arc uncertain. 
However, in many real world applications, the dimensionality of the underlying 
model and the vast amount of available data makes the investigation of the 
Bayesian posterior distribution of the model state given data computationally 
infeasible in on-line situations. An example of such an application is the global 
weather prediction: the computational models used currently involve on the 
order of 0(10^) unknowns, while a large amount of partial observations of the 
atmosphere, currently on the order of 0(10^) per day, are used to compensate 
both the uncertainty in the model and in the initial conditions. 

In situations like this practitioners typically employ some form of approx- 
imation based on both physical insight and computational expediency. There 
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are two competing methodologies for data assimilation which are widely im- 
plemented in practice, the first being filters [23] and the second being varia- 
tional methods [S]. In this paper we focus on the filtering approach. Many of 
the filtering algorithms implemented in practice are ad hoc and, besides some 
very special cases, the theoretical understanding of their ability to accurately 
and reliably estimate the state variables is under-developed. Our goal here is 
to contribute towards such theoretical understanding. We concentrate on the 
3DVAR filter which has its origin in weather forecasting [25] and is prototypical 
of more sophisticated filters used today. 

The idea behind filtering is to update the posterior distribution of the system 
state sequentially at each observation time. This may be performed exactly for 
linear systems subject to Gaussian noise: the Kalman filter [21]. For the case 
of non-linear and non-Gaussian scenarios the particle filter [13] can be used and 
provably approximates the desired probability distribution as the number of 
particles increases [:']. Nevertheless, standard implementations of this method 
perform poorly in high dimensional systems [31]. Thus the development of 
practical filtering algorithms for high dimensional dynamical systems is an active 
research area and for further insight into this subject the reader may consult 
[36, 15, 38, 20, 26, 7, 39, 4] and references within. Many of the methods used 
invoke some form of ad hoc Gaussian approximation and the 3DVAR method 
which we analyze here is perhaps the simplest example of this idea. These ad hoc 
filters, 3DVAR included, may also be viewed within the framework of nonlinear 
control theory and thereby derived directly, without reference to the Bayesian 
probabilistic interpretation; indeed this is primarily how the algorithms were 
conceived. 

In this paper we will study accuracy and stability for the 3DVAR filter. The 
term accuracy refers to establishing closeness of the filter to the true signal un- 
derlying the data, and stability is concerned with studying the distance between 
two filters, initialized differently, but driven by the same noisy data. Proving 
filter accuracy and stability results for control systems has a long history and 
the paper [32] is a fundamental contribution to the subject with results closely 
related to those developed here. However, as indicated above, the high dimen- 
sionality of the problems arising in data assimilation is a significant challenge in 
the area. In order to confront this challenge we work in an infinite dimensional 
setting, therby ensuring that our results are not sensitive to dimensionality. We 
focus on dissipative dynamical systems, and take the two dimensonal Navier- 
Stokes equation as a prototype model in this area. Furthermore, we study a 
data assimilation setting in which data arrives continuously in time which is a 
natural setting in which to study high time-frequency data subject to significant 
uncertainty. The study of accuracy and stability of filters for data assimilation 
has been a developing area over the last few years and the paper [(i] contains 
finite dimensional theory and numerical experiments in a variety of finite and 
discretized infinite dimensional systems extend the conclusions of the theory. 
The paper [37] highlights the principle that, roughly speaking, unstable direc- 
tions must be observed and assimilated into the estimate and, more subtly, that 
accuracy can be improved by avoiding assimilation of stable directions. In par- 
ticular the papers [(i, 3)7] both explicitly identify the importance of observing 
the unstable components of the dynamics, leading to the notion of AUS: assim- 
ilation in the unstable subspace. The paper [■")] describes a theoretical analysis 
of 3DVAR applied to the Navier-Stokes equation, when the data arrives in dis- 
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Crete time, and in this paper we address similar questions in the continuous 
time setting; both papers include the possibility of only partial observations in 
Fourier space. Taken together, the current paper and [ ] provide a significant 
generalization of the theory in [32] to dissipative infinite dimensional dynamical 
systems prototypical of the high dimensional problems to which filters are ap- 
plied in practice; furthermore, through studying partial observations, they give 
theoretical insight into the idea of AUS as developed in [G, 37]. The infinite 
dimensional nature of the problem brings fundamental mathematical issues into 
the problem, not addressed in previous finite dimensional work. We make use of 
the squeezing property of many dissipative dynamical systems [8, 34], including 
the Navier-Stokes equation, which drives many theoretical results in this area, 
such as the ergodicity studies pioneered by Mattingly [27, 1!)]. In particular our 
infinite dimensional analysis is motivated by the theory developed in [28] and 
[22], which are the first papers to study data assimilation directly through PDE 
analysis, using ideas from the theory of determining modes in infinite dimen- 
sional dynamical systems. However, in contrast to those papers, here we allow 
for noisy observations, and provide a methodology that opens up the possibility 
of studying more general Gaussian approximate filters such as the Ensemble 
and the Extended Kalman filter (EnKF and ExKF). 

Our point of departure for analysis is an ordinary differential equation (ODE) 
in a Banach space. Working in the limit of high frequency observations we for- 
mally derive continuous time filters. This leads to a stochastic differential equa- 
tion for state estimation, combining the original dynamics with extra terms ind- 
cuing mean reversion to the noisily observed signal. In the particular case of the 
Navier-Stokes equation we get a stochastic PDE (SPDE) with additional mean- 
reversion term, driven by spatially-correlated time-white noise. This SPDE is 
central to our analysis as it is used to prove accuracy and stability results for 
the 3DVAR filter. In particular, in the case when enough of the low modes of 
the Navier-Stokes equation are observed and the model has larger uncertainty 
than the data in these low modes, a situation known to practitioners as variance 
infiation, then the filter can lock on to a small neighbourhood of the true signal, 
recovering from the initial error, if the error in the observed modes is small. The 
results are formulated in terms of the theory of random and stochastic dynami- 
cal systems ['], and both forward and puUback type results are proved, leading 
to a variety of probabilistic accuracy and stability results, in the mean square, 
probability and almost sure senses. 

The paper is organised as follows. In Section 2 we derive the continuous- 
time limit of the 3DVAR filter applied to a general ODE in a Banach space, 
by considering the limit of high frequency observations. In Section 3, we focus 
on the 2D Navier-Stokes equations and present the continuous time 3DVAR 
filter within this setting. Sections 4 and 5 are devoted, respectively, to results 
concerning forward accuracy and stability as well as puUback accuracy and 
stability, for the filter when applied to the Navier-Stokes equation. In Section 
6, we present various numerical investigations that corroborate our theoretical 
results. Finally in Section 7 we present conclusions. 
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2 Continuous-Time Limit of 3DVAR 



Consider u satisfying the following ODE in a Banach space X : 

^^Tiu), u{0)^uo. (1) 

Our aim is to study online filters which combine knowledge of this dynamical 
system with noisy observations of u„ = u{nh) to estimate the state of the 
system. This is particularly important in applications where uq is not known 
exactly, and the noisy data can be used to compensate for this lack of initial 
knowledge of the system state. 

In this section we study approximate Gaussian filters in the high frequency 
limit, leading to stochastic differential equations which combine the dynamical 
system with data to estimate the state. As the formal derivation of continuous 
time filters in this section is independent of the precise model under consider- 
ation, we employ the general framework of (1). We make some general obser- 
vations, relating to a broad family of approximate Gaussian filters, but focus 
mainly on 3DVAR. In subsequent sections, where we study stability and accu- 
racy of the filter, we focus exclusively on 3DVAR, and work in the context of the 
2D incompressible Navier-Stokes equation, as this is prototypical of dissipative 
semilinear partial differential equations. 



2.1 Set Up - The Filtering Problem 

We assume that uq ~ N{mQ,Co) so that the initial data is only known sta- 
tistically. The objective is to update the estimate of the state of the system 
sequentially in time, based on data received sequentially in time. We define the 
flow-map 4' : X X E+ X so that the solution to (1) is u{t) = \E'(uo;0- Let 
H denote a linear operator from X into another Banach space Y, and assume 
that we observe Hu at equally spaced time intervals: 

yn = H^{uQ;nh)+r)n. (2) 

Here {?7„}„gN is an i.i.d sequence, independent of Mq, with 771 ~ A^(0,r). If we 
write u„ = ^(uo;n/i), then 

Un+i = h), (3) 

and 

j/,>„^iv(iJu„,r). (4) 

We denote the accumulated data up to the time n by 

Yn = {y^YU■ 

Our aim is to find P(m„|1^). 

We will make the Gaussian ansatz that 

nun\Yn)^N{m^,C„)- (5) 

The key question in designing an approximate Gaussian filter, then, is to find 
an update rule of the form 

(to„,C„) 1-^ (m„+i,C„+i) (6) 
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Because of the linear form of the observations in (2) , together with the fact that 
the noise is mean zero-Gaussian, this update rule is determined directly if we 
impose a further Gaussian ansatz, now on the distribution of Un+i given y„ : 

Un+l\Yn ~ 7V(to„+i, C„+i) (7) 

With this in mind, the update (6) is usually split into two parts. The first, 
prediction (or forecast), step is the map 

(to„,C„) 1-^ (m„+i,C„+i) (8) 

The second, analysis, step is 

(m„+i,C„+i) (m„+i,C„+i). (9) 

For the prediction step we will simply impose the approximation (7) with 

TO„+i = *(to„; h), (10) 

while the choice of C„+i will depend on the choice of the specific filter. For the 
analysis step, assumptions (4), (7) imply that 

w„+i|y„+i 7V(to„+i, c„+i) (11) 

and an application of Bayes rule, as applied in the standard Kalman filter update 
[21], and using (10), gives us the nonlinear map (6) in the form 

Cn+l — Cn+1 ~ Cn+lH* (r + HCn+lH*) ^ HCn+l (12a) 

m„+i = ^{m,,-h) + Cn+iH*{T + HCn+iH*r\yn+i~Hm„+i){l2h) 

The mean to„+i is an element of the Banach space X, and C„+i is a linear 
symmetric and non-negative operator from X into itself. 

2.2 Derivation of The Continuous-Time Limit 

Together equations (10) and (12), which are generic for any approximate Gaus- 
sian filter, specify the update for the mean once the equation determining Cn+i 
is defined. We proceed to derive a continuous-time limit for the mean, in this 
general setting, assuming that C„ arises as an approximation of a continuous 
process C{t) evaluated at t = nh, so that C„ « C{nh), and that h <^ 1. 
Throughout we will assume that F = h~^To. This scaling implies that the noise 
variance is inversely proportional to the time between observations and is the 
relationship which gives a nontrivial stochastic limit as /i — >■ 0. 
With these scaling assumptions equation (12b) becomes 

m„+i = ^'(m„;/i) + hCn+iH*{To + hHC„+iH*)-^ {y^^+i - H^{mr,; h)). 

Thus 

= \-Cn+iH [To+hHCn+iH ) (?/„+i-iJ*(m„; /i)). 

If we define the sequence {zn}nez+ by 

Z„+i = Zn + hyn+i, Zo = , 
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then we can rewrite the previous equation as 



rhn+i ~ fhn _ ^(to„; h) - m„ 
h ~ h 



(13) 



Note that 



+ C„+iff*(ro + hHCn+iH*)-' ( ^" - ^*("in; h) 



*(m„; h)=fhn + hF{fhn) + 0{h'^). 



This is an Euler-Maruyama-hke discretization of a stochastic differential 
equation which, if we pass to the hmit of /i — > in (13), noting that we have 
assumed that C„ w C{nh) for some continuous covariance process, is seen to be 



dm , „,,^^_i / dz 



F{fh) + CH*r^' - Hmj , to(0) = toq. (14) 

Equation (14) is similar to the observer equation in the nonlinear control 
literature [32]. Our objective in this paper is to study the stability and accuracy 
properties of this stochastic model. Here stability refers to the contraction 
of two different trajectories of the filter (14), started at two different points, 
but driven by the same observed data; and accuracy refers to estimating the 
difference between the true trajectory of (1) which underlies the data, and the 
output of the filter (14). Similar questions are studied in finite dimensions in 
[32]. However, the infinite dimensional nature of our problem, coupled with the 
fact that we study situations where the state is only partially observed {H is not 
invertible on X) mean that new techniques of analysis are required, building on 
the theory of semilinear dissipative PDEs and infinite dimensional dynamical 
systems. 

We now express the observation signal z in terms of the truth u in order to 
facilitate study of filter stability and accuracy. In particular, we have that 

Zn+l — Zn\ ^/To 
r = Vn+l = HUn+1 H 7fAw„+i, 

where {Awn}neN is an i.i.d sequence and Awi ~ N{0, 1) in Y. This corresponds 
to the Euler-Maruyama discretization of the SDE 

g^i/^.+ v/fo^, z(0) = 0. (15) 

Expressed in terms of the true signal u, equation (14) becomes 

^ = Tim) + CH*r^'H {u-m) + CH*r-'^^^. (16) 

We complete the study of the continuous limit with the specific example of 
3DVAR. This is the simplest filter of all in which the prediction step is found 
by simply setting C„+i = C for some fixed covariance operator C, independent 
of n. Then equation (12) shows that Cn+i = C + 0{h) and we deduce that 
the limiting covariance is simply constant: C{t) = C{t) ^ C for all t > 0. The 
present work will focus on this case and hence study (IG) in the case where 
C = C, a constant in time. 
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3 Continuous-Time 3DVAR for Navier-Stokes 



In this section we describe application of the 3DVAR algorithm to the two 
dimensional Navier-Stokes equation. This will form the focus of the remainder 
of the paper. In subsection 3.1 we describe the forward model itself, namely 
we specify equation (1), and then in subsection 3.2 we describe how data is 
incorporated into the model, and specify equation (16), and the choices of the 
(constant in time) operators C = C and Tq which appear in it. 



3.1 Forward Model 

Let denote the two-dimensional torus of side L : [0, L) x [0, L) with periodic 
boundary conditions. We consider the equations 

dtu{x,t) ~ i'Au{x,t) + u{x,t) ■ \'u{x,t) +Vp{x,t) — f{x) 
V-u{x,t) = 

u{x,Q) = ^0(2;) 

for all X e and t e (0,oo). Here u: x (0,oo) — > is a time-dependent 
vector field representing the velocity, p: x (0, 00) — > M is a time-dependent 
scalar field representing the pressure and / : — >■ is a vector field represent- 
ing the forcing which we take as time-independent for simplicity. The parameter 
V represents the viscosity. We assume throughout that mq and / have average 
zero over T^; it then follows that u{-,t) has average zero over for all t > Q. 
Define 

T := I trigonometric polynomials u : ^ V ■ u = 0, J u{x) dx = 0^ 

and v. as the closure of T with respect to the norm in {L^{T'^))^ = L^(T^,M^). 

We let P : (L^(T^))^ — H denote the Leray-Helmholtz orthogonal projector. 
Given k = (fei, fe)""", define k-^ :— (/c2, —ki)"^. Then an orthonormal basis for H 
IS given by Vfe: K^ where 

^.(x):=^exp(^— j (17) 

for fc e \ {0}. Thus for u £ H we may write 

u{x,t)^ X! '^k{t)ipk{x) 
feez2\{o} 

where, since u is a real-valued function, we have the reality constraint u-k = 
—Uk- We define the projection operators P\ : H ^ H and Q\ : % ^ % iov 
A e N U {00} by 

Pxu{x,t)= Ukit)Mx), Qx^I-Px- 

|27rfep<AL2 

Below we will choose the observation operator H to be Px. 

We define A — — j^PA, the Stokes operator, and, for every s £ K, define 
the Hilbert spaces "H* to be the domain of A"/^. We note that A is diagonalized 
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in TH. in the basis comprised of the {V'felfeez^Xfo} ^^id that, with the normahzation 
employed here, the smallest eigenvalue of ^ is Ai = 1. We use the norm || • ||^ :— 
(•, A*-), the abbreviated notation ||u|| for the norm on V :~ H^, and | • | for the 
norm on "H := 'HP. 

Applying the projection P to the Navier-Stokes equation we may write it as 
an ODE in U: 

--+SAu + B(u,u) = f, u(0)=uo. (18) 
at 

Here S — Att'^v/L^ and the term B{u, v) is the symmetric bilinear form defined 

by 

B{u, v) = -P{u ■ Vw) + -P{v ■ Vu) 

for all u,v G V. Finally, with abuse of notation, / is the original forcing, 
projected into H. Equation (18) is in the form of equation (1) with 

T{u) = -6Au-B{u,u) + f. (19) 

See [>] for details of this formulation of the Navier-Stokes equation as an 
ODE in H. The following proposition is a classical result which implies the 
existence of a dissipative semigroup for the ODE (18). See Theorems 9.5 and 
12.5 in [ ] for a concise overview and [3.3, 34] for further details. 

Proposition 3.1. Assume that uq G T-L^ and f E %. Then (18) has a unique 
strong solution on t € [0, T] for any T > : 

L°°((0,T);-H^) nL2((0,r);-H^), ^ G ((0, T); . 

Furthermore the equation has a global attractor A and there is R € (0, cxi) such 
that, if Uq G a, then the solution from this initial condition exists for all t R 
and supjgjj ||M(t)|p = R. 

We let {'!'(•, t) : V.^ — > 'H^}t>o denote the semigroup of solution operators 
for the equation (18) through t time units. We note that by working with weak 
solutions, 'J'(-,i) can be extended to act on larger spaces , with s G [0,1), 
under the same assumption on /; see Theorem 9.4 in [29]. 

3.2 3DVAR 

We apply the analysis of the previous section to write down the continuous time 
3DVAR filter, namely (IC) with C{t) = C constant in time, for the Navier-Stokes 
equation. We take X = H and throughout we assume that the data is found 
by observing P\u at discrete times, so that H* = H = P\ and Y = P\H. We 
assume that A, Fq and C commute and, for simplicity of presentation, suppose 
that 

C^ualA^^^, To = alA-^f'Py,. (20) 

We set a = C — /3- These assumptions correspond to those made in [ ] where 
discrete time filters are studied. Note that A'^^'^ is defined on H^] it is also 
defined on Y for every s G M, provided that A is finite. 
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From equations (16), using (19) and the choices for C and Tq we obtain 

'^+6Am+B(m,m)+ijA-^"'Px(m-u) = f+uj<7oA-^°'-^Px'^, m(0) = fho 
at at 

(21) 

where is a cyhndrical Brownian motion in Y. In the foUowing we consider 
the cases of finite A, where the data is in a finite dimensional subspace of Ji, 
and infinite A, where P\ = I and the whole solution is observed. 

Lemma 3.2. For A = oo assume that 4a + 2/3 > 1. Then the stochastic convo- 
lution ^ 

WA{t) = I e^(*-")^A-2"-'3p^d^(s) 
Jo 

has a continuous version in C'^([0,T],V) with all moments EsupjQ j^j 
finite for all T > and p > 1. 

Proof. If A < oo then the covariance of the driving noise is automatically trace- 
class as it is finite dimensional; since 4q + 2/3 > 1 it follows that the covariance 
of the driving noise is also trace-class when A = oo. The desired result follows 
from Theorem 5.16 in [ ]. For the moments see [V2, (5.23)]. □ 

It is only in the case of full observations (i.e., A — oo) that we need the 
additional regularity condition 4a -I- 2/3 > 1. This may be rewritten as ^ > i + j/? 
and relates the rate of decay, in Fourier space, of the model variance to the 
observational variance. Although a key driver for our accuracy and stability 
results (see Remark 4.4 below) will be variance inflation, meaning that the 
observational variance is smaller than the model variance in the low Fourier 
modes, this condition on C allows regimes in which, for high Fourier modes, the 
situation is reversed. 

Proposition 3.3. Assume that uq A and let u he the corresponding solution 
of (18) on the global attractor A. For X ~ oo suppose Aa + 2/3 > 1 and a > — ^. 
Then for any initial condition fh{0) € % there is a stochastic process fh which 
is the unique strong solution of (21) in the spaces 

me i2((o,T),v) nc"([o,r],-H) 

for all T > 0. Moreover, 

Ellmf , . +E||a||2 , . <oo. 

" ((0,T),-h) " "L^[{0,T),Vj 

To be more precise 

meL2(f^,C°,([0,oo),H)) nL2(r!,LL([0,oo),V)) . 

Proof. The proof of this theorem is well known without the function u and 
the additional linear term. See for example Theorem 15.3.1 in the book [11] 
using fixed point arguments based on the mild solution. Another reference is 
[16, Theorem 3.1] based on spectral Galerkin methods. See also [18] or [30]. 
Nevertheless, our theorem is a straightforward modification of their arguments. 
For simplicity of presentation we refrain from giving a detailed argument here. 
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The existence and uniqueness is established either by Galerkin methods or 
fixed-point arguments. The continuity of solutions follows from the standard 
fixed-point arguments for the mild formulation in the space C°([0,T],'H). 

Finally, as we assume the covariance of the Wiener process to be trace-class, 
the bounds on the moments are a straightforward application of Ito's formula 
(cf. [12, Theorem 4.17]) to |mp and to in order to derive standard a- 

priori estimates. This is very similar to the method of proof that we use to 
study mean square stability in Section 4.1. 

The additional linear term u!A~^°'Px'm does not change the result in any 
substantive fashion. If A < oo then the proof is essentially identical, as the 
additional term is a lower order perturbation of the Stokes operator. 

If A = oo then minor modifications of the proof are necessary, but do not 
change the proof significantly. This is since, for a > — |, the additional term 
uiA~'^°'rh is a compact perturbation of the Stokes operator. 

The additional forcing term, depending on u, is always sufficiently regular for 
our argument, as we assume u to be on the attractor (see Proposition 3.1). □ 

Remark 3.4. For A = oo it is possible to extend the preceding result to other 
ranges of a, but this will change the proof. Hence, for simplicity, for X — oo we 
always assume that a > — . 

We comment later on the fact that the solutions to (21) generate a stochastic 
dynamical system. As we need two-sided Wiener-processes for this we postpone 
the discussion to Section 5. 

4 Forward Accuracy and Stability 

We wish to study conditions under which two filters, starting from different 
points but driven by the same observations, converge (stability); and conditions 
under which the filter will, asymptotically, track the true signal (accuracy). 
Establishing such results has been the object of study in control theory for 
some time, and the paper [:!2] contains foundational work in both the discrete 
and continuous time settings. However the infinite dimensional nature of the 
problem at hand brings significant new challenges to the analysis. The key idea 
driving the proofs is that, although the Navier-Stokes equations themselves may 
admit exponentially diverging trajectories, the observations can counteract this 
instability, provided the observation space is large enough. Roughly speaking 
the exponential divergence of the Navier-Stokes equations is dominated by a 
finite set low Fourier modes, whilst the rest of the space contracts. If the 
observations provide information about enough of the low Fourier modes, then 
this can counteract the instability. This basic idea underlies the accuracy and 
stability results proved in subsections 4.1 and 4.2. 

A key technical estimate in what follows is the following (see [■>'>]): 

Lemma 4.1. For the symmetric bilinear map 

B{u, v) = \P{u ■ Vw) + \P{v ■ Vu) 
there is constant K' > 1 such that for all v,w € V 

{B{v,v)-B{w,w),v-w) < i^'||w||||u- w|| • \v-w\, (22) 
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mw,v),v)\<K'\\w\\\\v\\\v\ and mw,v), z)\ < K'\\v\\\\w\\\\z\\ . (23) 
Furthermore, for all v £ V, 

{B{v,v),v)=0 (24) 

Notice that (22) implies that, for K = [K'f/S, 

{B{v,v)-B{w,w),v-w) < ^K\\wf\v - + ^5\\ V ~ w\\ , VvjWGV. (25) 

This estimate will be used to control the possible exponential divergence of 
Navier-Stokes trajectories which needs to be compensated for by means of ob- 
servations. 

Proof of Lemma 4-1- We give a brief overview of the main ideas required to 
prove this well known result. First notice that the assumption K' > 1 is without 
loss of generality. We need this later for simplicity of presentation. 

Then (22) is a direct consequence of (23) and (24), by using the identity 

B{v, v) — B{w, w) = B{v + w,v — w) = B{v — w,v — w) + 2B{w, v — w) 

For simplicity of presentation, we use the same constant in (22) and (23). 

For Navier-Stokes it is well-known that {{w ■ V)w, v) = 0, as the divergence 
of w is 0. Thus there is constant ci such that 

2\{Biw,v),v)\ = {{vV)w,v)\<c,\\w\\\v\l, . 

Since, in two dimensions H^^^ ~ D{A^/^) is embedded into L'^, there is constant 
C2 such that \{B(w,v), z)\ < C2||u>||||u|| i\\z\\ i . The first result in (23) then 
follows from the interpolation inequality i < c|u|||u|| and the second from 

H 2 

the embedding ||t'||^i<c||t;||. □ 

Finally, in the following a key role will be played by the constant 7 defined 
as follows: 

Assumption 4.2. Let 7 be the largest positive constant such that 

^j\h\^ < {ojA-^"Pxh,h) + ^S\\hf forallheV. (26) 

It is clear that such a 7 always exists, and indeed that 7 > 5, as one has 
{A^^'^Pxh, h) > 0. We will study how 7 depends on A and w in subsequent 
discussions where we show that, by choosing A and cj large enough, 7 can be 
made arbitrarily large. 

4.1 Forward Mean Square Accuracy 

Theorem 4.3 (Accuracy). Let fh solve (21), and let u solve (18) with initial 
condition on the global attractor A. For \ = 00 assume AaA-2j3 > 1 and a > 
Suppose that 7, the largest positive number such that (26) holds, satisfies 

7 = I{R + 7o for some 70 > 0, 
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where K is the constant appearing in (25) and R, recall, is defined by R ^ 
suPtsE Then 

E|m(i)-u(t)|2 <e~^«*|m(0)-u(0)|2+wV^ / e-^°^'-'hi&ceH{A-^"~^'^ Px)ds. 

Jo 

As a consequence 

limsupE|m(<) < f w^cr^trace^M-^^-^'^P^). 

Proof. Define the error e = fh — u and subtract equation (18) from (21) to 
obtain 

de + SAe ^ (b{u, u) - B{m, m) - wA^^^p^e^ dt + ujaoA-^"''^ PxdW . 

Using the Ito formula from Theorem 4.17 of [' '], together with (25), yields 

id|ep <(-i<5||e||2 + lK\\u{t)f\e\^ - ^-^^p^g, e)) 

+ {e,ujaQA-^''-^PxdW) + icjV^trace« (^-'^"-^'^Pa)^^ . 

Here we have used the fact that the projection P^ and A commute. Applying 
(26) and taking expectations we obtain 

jE\e{t)\^ < ~{i^K\\uit)f) •E|e(i)P+c.V2trace«(A-4"-2^PA) , 

But supoo ||M(i)|p = P < oo by Proposition 3.1 and hence, by assumption on 
7, 

|E|e(t)|2 < -70 •E|e(t)|2 +c.2a2trace«(A-4"-2'3pA). , 

The result follows from a Gronwall argument. □ 

Remark 4.4. We now briefly discuss the choice of parameters to ensure sat- 
isfaction of the conditions of Theorem 4-3, and its implications. To this end, 
notice that K and R are independent of the parameters of the filter, being deter- 
mined entirely by the Navier-Stokes equation (18) itself. To apply the theorem 
we need to ensure that 7 defined by (26) exceeds KR. Notice that 

^7|/ip < {ojA-^'^Pxh, h) + ]^&\\hf for all h e PxV 

requires that 

^7 < ^ + ls\k\^ for all \k\^ < XL^ATr'. (27) 
On the other hand, 

^-f\h\^ < {ojA-^"Pxh, h) + ]^5\\hf for all h e QxV 
requires that 

7 < 5\k\^ for all \k\^ > XL^/Att^. (28) 
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Since the global minimum of the function x G i— > ojx ^" + |(5x occurs at 
a point we see that the maximum value of 7 such that (26) 

holds, 7max; is 

This demonstrates that, provided A is large enough, and u is large enough, then 
the conditions of the theorem are satisfied. 

In summary, these conditions are satisfied provided that enough of the low 
Fourier modes are observed (X large enough), and provided that the ratio of the 
scale of the covariance for the model to that for the observations, uj, is sufficiently 
large. Ensuring that the latter is achieved is often termed variance inflation in 
the applied literature and our theory provides concrete analytical insight into 
the mechanisms behind it. Furthermore, notice that once A and uj are chosen 
to ensure this, then the asymptotic mean square error will be small, provided 
e := ujgq is small that is, provided the observational noise is sufficiently small. 
In this situation the theorem establishes a form of accuracy of the filter since, 
regardless of the starting point of the filter, 

linisupE|m(i) < — e^^race^ M-^'^-^/Jp^y 

t->oo 70 

4.2 Forward Stability in Probability 

The aim of this section is to prove that two diff'erent solutions of the continuous 
3DVAR filter will converge to one another in probability as t — > 00. Almost sure 
and mean square convergence is out of reach in forward time. However, almost 
sure pullback convergence is possible and we study this in the next section. 
Throughout this section we define, for u on the attractor, 

R' = swp\f + ujA-^'^PxuW (29) 

and we assume that R' < 00. From this we define 

= + f ^'^o'tracc«(A-4"-2/^P,). (30) 

Theorem 4.5. Let fhi solve (21) with initial condition fh{0) = fhi{0) and let u 
solve (18) with initial condition on the global attractor A. For A = 00 assume 
that 4a + 2/3 > 1 and a > — i. Let R" be defined as above, and suppose 7, 
the largest positive number such that (26) holds, satisfies 7 = R" + 70 for some 
70 > 0. 

Then for all rj G (0, 70) 

\rhi{t) — TO2(i)|e''* — > in probability as t 00. 

Proof. It follows from Lemma 4.6 below that, for any fixed t > 0, 

P(|mi(0-m2(0l' < |mi(0)-m2(0)pe-27ot) > p(^l j' K\\m2{s)fds < 7-70) 

(31) 

Thus to establish the desired convergence in probability, it sufltices to establish 
that the right hand side converges to 1 as t — )■ 00. 
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Taking the inner-product of equation (21) with m, applying (24) and using 
the Ito formula from Theorem 4.17 of [12], we obtain 

id|mp <(-5\\m\\^ - {ujA-^"Pxm,m) + {f + ujA-^°'Pxu,m)^dt 

+ {m,ujaoA-^"-^PxdW) + icj^^^trace^ (A-^^-^/Jp^)^^ 

<{-ls\\m\\' + Ys\f + ^A-'"Px^\-i)dt 
Notice that, from the Poincare inequality, we have that 

d\mf < (^-S\mf + ^R'+iJ^altracen{A-'^'''^'^Px)yt+2{m,ujaoA-^°'~^^PxdW) 

(32) 

From this inequality we can deduce two facts. Taking expectations gives 
d{E\m{t)\^) < (^-^6E\m\^ + ^R'^dt + uj^crltrSicen{A-^°'"^^Px)dt;, 
and thus with R" from (30) 



K|m(t)r < 1 ^ - - ' R" 

We also see that 



limsupE|m(i)|2 < — i?' + -a;2cr2trace« (A'^^-^/Jp^^ ^ " (33) 



I f^\m{s)\'ds<^+^-\mm^+m, (34) 



2 



where we have defined 

Ht)^ 7 f {m{s),uja^A--''--^PxdW{s)) 
c JO 

Observe that, by the Ito formula, 

E|/(<)|' < 4 rE|m(s)pds 
t Jo 

for the positive constant c — uj'^aQ\\A~''^°'~'^ PxW^^^y Using (33) we deduce that 
/(i) — > in mean square and hence in probability. As a consequence we deduce 
that (34) implies that 

K\\m{s)\\^ds < R") ^ 1 fort ^00. 



This completes the proof. □ 

Lemma 4.6. Let fhi solve (21) with the same u on the attractor but with 
different initial conditions fhi{0). For X = 00 assume that 4a + 2/3 > 1. Fix 
t > and recall that K is the constant appearing in (25). Suppose that 7, the 
largest positive number such that (26) holds, satisfies 

I ft 

K\\fri2{s)\\^ ds + 7o < 7 



t 

for some 70 > 0. Then 

|mi(t) - m2(i)|' < e-2'^°*|mi(0) - m2(0)|2 
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Proof. We define the error e — fhi — m2, subtract equation (21) from itself and 
take the inner- product with e to obtain, using (25), 

i^lep = (-F(mi)--^(™2),e)-(c.A-2"P;,e,e) 

< -6\\ef + K\\fh^{t)f\e\^ ~ {ujA-^"Pxe,e) . 
Applying (26) we obtain 

\j^\e{t)\^<{K\\m^{t)f-^)-\e{t)\''. 
Integrating this inequality yields 

|e(t)p < exp(2^*(if||m2(t)|P - 7)^*) • |e(0)p . 

□ 

This gives the desired result. 

Remark 4.7. Satisfying the condition on 7 for the stability Theorem 4.5 is 
harder than for the accuracy Theorem 4-3. This is because R" can grow with lo 
and so analogous arguments to those used at the end of the previous subsection 
may fail. However different proofs can be developed, in the case where ctq is 
sufficiently small, to overcome this effect. 



5 Fullback Accuracy and Stability 

In this section we consider almost sure accuracy and stability results for the 
3DVAR algorithm applied to the 2D-Navier-Stokes equation. We use the no- 
tion of puUback convergence as pioneered in the theory of stochastic dynamical 
systems, as we do not expect almost sure results to hold forward in time. In- 
deed, as shown in the previous section, convergence in probability is typically 
the result of forward studies of stability. 

The methodology that we employ derives from the study of semilinear equa- 
tions driven by additive noise; in particular the Ornstein-Uhlenbeck (OU) pro- 
cess constructed from a modification of the Stokes' equation plays a central 
role. Properties of this process are described in subsection 5.1, and the neces- 
sary properties of the 3DVAR Navier-Stokes filter are discussed in subsection 
5.2. In both subsections a key aspect of the analysis concerns the extension of 
solutions to the whole real line t e M. Subsections 5.3 and 5.4 then concern 
accuracy and stability for the filter, in the pull-back sense. 

In the following we define the Wiener process 

W := ujaoA-'^°'-I^PxW, 

and recall that when X — 00 we assume 4a -I- 2/3 > 1 and a > — ^. In this section 
the driving Brownian motion is considered to be two-sided: W e C(M, T-L). This 
enables us to study notions of puUback attraction and stability. With this 
definition, 3DVAR for (18), namely equation (21)), may be written 

+ 5Afh + B{fh,m) + LoA~'^'^Px{fh- u) ^ f +'^, to(0) = mo . (35) 

We employ the same notations from the previous sections for the nonlinearity 
J-"(it), the Stokes operator A, the bilinear form B, and the spaces T-L and V. 



15 



5.1 Stationary Ornstein-Uhlenbeck Processes 

Let > and define the stationary ergodic OU process as follows, using 
integration by parts to find the second expression: 

t 

-{t-s){SA+4 



Z^{t) := / e-^'-'^^'^'+^^dWis) (36a) 

J — OO 

= W{t)- f (M + (/.)e-(*-^)(^^+'^)W(s)ds . (36b) 



Note that satisfies 

dtZ^ + {6A + dp)Z^^dtW. (37) 

With a shght abuse of notation we rewrite the random variable Z^{0) as ^^(yV), 
a function of the whole Wiener path 1 1-)- W{t). Thus Z^{t) = Z^{9tW), where 
9t is the stationary ergodic shift on Wiener space defined by 

etW{s) = Wit + s) - W(t) for all s e M. 

The noise is always of trace-class, in case either A < oo or 4q; + 2/3 > 1. Recall 
that by Lemma 3.2, the OU-process Z^ has a version with continuous paths in 
V. We will always assume this in the following. It is well known that Z^ satisfies 
the BirkhofF ergodic theorem, because it is a stationary ergodic process; we now 
formulate this fact in the pullback sense. 

Theorem 5.1 (Birkhoff Ergodic Theorem). For A = oo assume that 4a + 
2/3 > 1. Then 



1 



limsup- / |lZ^(T)|l^dT = E|1^40)|l^ . 

s— foo S 

Proof. Just note that Z^{t) — Z^lOrW), and thus 

-/ \\Z^{r)\\^dr= - f \\Z^{e^rW)\\''dT^E\\Z4W)\\^ for s ^ oo 

■5 J-s ^ Jo 

by the classical version of the BirkhofF ergodic theorem, as B^tW, t > is 
stationary and ergodic. □ 

We can reformulate the implications of the ergodic theorem in several ways. 

Corollary 5.2. For A = oo assume that 4a + 2/3 > 1. There exists a random 
constant C(yV) such that 

1 r° 

— \\ZJT)\\^dT <C{W) forallsKQ. 

\S\ Js 

Furthermore, for any e > there is a random time te{W) < such that 

1 r° 

— ||Z^(T)||2dT < (l + e)E|lZ^(0)|p for all s < t,{W) < 0. 
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This result immediately implies 

\z4erW)\\^dT = I \\z^ier+tW)\\''dT < ciOtW) . 



t 





2, 



Finally we observe that it is well-known that the Ornstein-Uhlenbeck process 
is a tempered random variable, which means that Z^[Og'W) grows sub- 
exponentially for s — >■ — oo, and in fact it grows slower that any polynomial. 
We now state this precisely. 

Lemma 5.3. For A = oo assume that 4a + 2/? > 1. Then on a set of measure 
one 

lim \\ZJs)\\-\s\"' = Q foralle>0. 

Proof. The claim follows from Proposition 4.1.3 of [1] which states that for any 
positive functional h on Wiener paths such that Esup(g[o h{6tW) < oo one 
has limt^oo jh{9tW) = 0. Here /i(W) = ||Z0(W)||p, where the moment is finite 
due to Lemma 3.2. □ 

In addition to the preceding almost sure result, the following moment bound 
on Z^ is also useful. It shows that is of order ctq and converges to for 
— oo. In the following it may be useful to play with 0, and even to use 
random 0, as our estimates hold path- wise for all (j). 

Lemma 5.4. For A = oo assume that 4a 4- 2/3 > 1. Then, for all p > 1 there 
is a constant Cp > such that 

(E||Z^(t)||2p)^^^ < CpUj^(T^-trace{{SA + (l))-^A^-'^''-^PFx}, V t G M. 

Proof. Due to stationarity it is sufficient to consider E||Z0(O)|pP. Due to Gaus- 
sianity it is enough to consider p = 1. 



E\\Z^{0)f ^ E\A^/^Z^{0)\'^ = Lj^alE A^l'^ / e''^^^^'^'^ A-'^°--^ FxdW{s) 

J —OO 

Thus by the Ito-Isometry we obtain (projection Px commutes with A) 
E||Z40)f = c^V2.trace(r e^'^'^+'^'> A^-^^-^^ P^ds^ 



-uj^ctq ■ trace 



□ 



Remark 5.5. A key conclusion of the preceding lemma is that, if e uctq (as 
defined in Remark 4-4) small, then all moments of the OU process Z^ are 
small. Furthermore, the parameter (f> can be tuned to make these moments as 
small as desired. 
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5.2 Solutions Continuous Time 2D Navier-Stokes Filter 



In the following we denote the solution of (35) with initial condition m(s) — fho 
and given Wiener path W by S{t, s,W)mo. This object forms a stochastic 
dynamical system (SDS); see [10, 9]. We cannot use directly the notion of a 
random dynamical system, as in [I], because of the non-autonomous forcing u 
in (35). 

The fact that the solution of the SPDE (35) can be defined path-wise for 
every fixed path of W, can be seen from the well-known method of changing 
to the variable v := m — Z^. (see Section 7 of [10] or Chapter 15 of [11], for 
example). Now, since satisfies (37), subtraction from (35) shows that v solves 
the random PDE 

j^v+5Av+Biv,v)+2Biv,Z^)+BiZ^,Z^)+u;A-^"iv+Z^-u)~<pZ^ = / . (38) 

This can be solved for each given path of W with methods similar to the ones 
used for Proposition 3.1 (see also Proposition 3.3). Once, the solution is defined 
path-wise, the generation of a stochastic dynamical system is straightforward. 
Let us summarize this in a theorem: 

Theorem 5.6 (Solutions). For all uq on the attractor A the Navier-Stokes 
equation (18) has a solution u € i°°(M,V). Now consider the 3DVAR filter 
written in the form of equation (38). In the case A = oo assume that a > 
and 4a -f 2/3 > 1. For any s G M, any path of the Wiener process W, and any 
initial condition v(s) — fh{s) — Z^{s) G % equation (38) has a unique solution 

z;eCL([s,cx)),H)niL([s,cx3),V). 

This implies the existence of a stochastic dynamical system S for (35). 

Proof. The first statement follows directly from Proposition 3.1 if we take a 
solution on the attractor; in that case it follows that, in fact, u € L°°(M, V). 
Proof of the second statement is discussed prior to the theorem statement. □ 

5.3 Fullback Accuracy 

Here we show that in the pullback sense solutions m for large times stay close 
to M, where the error scales with the observational noise strength erg. Recall K 
and K' defined in Lemma 4.1 and R the uniform bound on u from Proposition 
3.1. 

Theorem 5.7 (Pullback Accuracy). Let fh solve (21), and let u solve (18) 
with initial condition on the global attractor A. In the case A = oo assume 
additionally that Aa + 2(3 > 1 and a > — |. Suppose that 7 from (26) is 
sufficiently large so that 

i4r(17E||Z0||2 + 16i?) <7. (39) 
Then there is a random constant r(yV) > such that for any initial condition 
limsup \S if s,W)mo - u{t) - Z^{etW)\^ < r{0tW) . 
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with a finite constant 

r{W)^-^j expi^J {16K(\\Z4^- + R)-j)drjjT^dT , 

where T := K'\\Z^\\{\\Z^\\ + 2\\u\\) + (j)\Z^\ + uj\A-'^'^PxZ^\ where K' and K := 
{K'Y /5 are as defined in Lemma 4.1. 

Remark 5.8. Regarding Theorem 5.7 we make the following obervations: 

• In (39) the contribution E||Z0|p can be made arbitrarily small by choosing 
cj) sufficiently large, or is small if e := wctq is sufficiently small; see Lemma 
5.4- Thus 16RK < j is sufficient for accuracy. With a more careful 
application of Young's inequality, we could also get rid of several factors 
of 2, recovering the condition RK < 7 from the forward accuracy result of 
Theorem 4-3. 

• The assumption that u lies on the attractor could we weakened to a con- 
dition on the limsup of u. We state the stronger condition for simplicity 
of proofs. 

• In the language of random dynamical systems, the theorem states that 
the .stochastic dynamical system S{t, sW)mo has is a random pullback ab- 
sorbing ball centered around u{t) with radius scaling with the size of the 
stochastic convolution Z^. By Lemma 5.4, this scales as 0{e) for e — ujctq 
sufficiently small; thus we have derived an accuracy result, in the pullback 
sense. 

Proof. (Theorem 5.7). Consider the difference d = fh — u, where fh(t) — 
S{t,s)fho. This solves 

dtd + SAd + B{d, d) + 2B{u, d) + uA-^^Txd = dtW . (40) 

In order to get rid of the noise, define ip = d — Z^ = fh — u — Z^, where Z^ is 
the stationary stochastic convolution. Since Z^ solves (37) the process if solves 

dt^ + 6A^ + B{^ + Z^,ijj + Z^) + 2B{u, ^ + Z^)+ uA-^'^P^ (^ + Z^) - = . 

(41) 

From this random PDE, we can take the scalar product with V' to obtain, using 
(24), 

\dt\-<p\'' + 5Uf = -{2B{Z^,iP) + B{Z^,Z^) +2BM + Z^),iP) 
- {uA-^''Px{^ + Z^) - 4>Z^,^) . 

Using (26) and Lemma 4.1 we obtain 

\dt\^\'' + lll^f + < ~{2B{Z^,i;)+B{Z^,Z^) + 2B{u,i; + Z^),i;) 

- {ujA~^'^PxZ^~(j)Z^,i,) 
< 2K' {\\Z4 + \\u\\) ■ m ■ 

+ K'\\Z4-i\\Z4+2\\u\\)-\m 
+ {q>\Z^\+u;\A~^'^PxZ^\)-\^\. 
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Recall that 

r - K'\\z4{\\z4 + 2\\u\\) + ^\Z4 + uIa-^'^p^z^ . 

Thus we have, using the Young inequality in the form ab < ^a^ + ^b'^ twice, 

+ lur + < ^K'i\\z4 + Mrnrn +t-m 
<4K{\\z4 + \\u\\r\i,\^ + lT' + lur, 

since K — {K')'^/S. Hence 

dtm'+im'<8Ki\\Z^\\ + \\u\\r-\^\' + lT' . 

Comparison principle with = ™o ^ w(s) — Z^{s) yields (using the bound 
on u and (a + 6)^ < 2a'^ + 26^) 

IV-WP < 1^0 - uis) ~ Z4s)\^ e^p(^j\l6K{\\Z4^ + R) - j]dr) 

+ exp(^ [mK{\\Z4^ + R) - j]dT^T^dr 

Thus, we can now use BirkhofFs theorem and the sub-exponential growth for 
Z^. We obtain for 7 sufficiently large (as asserted by the Theorem), that there 
is a random time io(W) < such that for all s < to{W) < 

\m\' < ^ J' e^p(^j\l6K{\\Z4^ + R)-j]dTy'dr . 

Recall that ip{t) = S{t, s, 'W)rho — Z{t)—u{t). This finishes the proof, as the right 
hand side is almost surely a finite random constant, due to Birkhoffs ergodic 
theorem and sub-exponential growth of 2'^ and hence (see Lemma 5.3). □ 



5.4 Fullback Stability 

Now we verify that under suitable conditions all solutions of (35) pullback con- 
verge exponentially fast towards each other. We make the assumption that 
BirkhofF bounds hold for the solution rh (see theorem statement below to make 
this assumption precise). These bounds do not follow directly from Birkhoffs 
ergodic theorem, as the equation is non-autonomous due to the presence of u. 
Whilst it should be possible to establish such bounds, using the techniques in 
[ ' ~] or [ ' '], doing so is technically involved, as one needs to use random 0's in 
the definition of Z^. In order to keep the presentation at a reasonable level, we 
refrain from giving details on this point. 

Theorem 5.9 (Exponential Stability). Assume there is one initial condition 
ffiQ^ such that the corresponding solution S{t, s, W)ffS^^ satisfies Birkhoff-bounds. 
To be more precise, we assume that 7 from (26) is sufficiently large that, for 
some 7] > and K = [K')"^ /5 from Lemma 4-1, 

limsup / \\S{T,s,W)fnl^'^fdT<-i-2'q. (42) 

s— f — 00 t S Jg 

Let ffifP be any other initial condition. Then 

lim \S{t, s, W)to[,^^ - S{t, s, yV)fh^o^ \ ■ e''^*"'') = 0. 
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Recall we verified in Theorem 5.7 that (35) has a random pullback absorbing 
set in centered around u{t). Together with Theorem 5.9 this immediately 
implies that Equation (35) has a random pullback attractor in consisting of 
a single point that attracts all solutions. Let us remark, that we did not show 
that the attractor also puUback-attracts tempered bounded sets, but this is a 
straightforward modification. 

Proof. (Theorem 5.9) Define here v — fhi — m2, where fhi{t) — ^(t, s, W)mQ*-* 
are solutions of (35) with different initial conditions. It is easy to see by the 
symmetry of B that 

dtv + SAv + B{mi + m2,v) + uA-'^°'Pxv = 

or 

dtV + SAv + 2B{mi,v) - B{v, v) + ujA~^°'Pxv = . 

Thus 

]^dt\v\'' + 5\\vf + uiA-^^^Pxv^v) <2i^'||mi||||t;|||i;| . 

By (26) 

9t|vp+,5||w||2+7|tf <AK'\\mi\\\\v\\\v\ . 
Hence, using Young's inequality {ah < jgo^ + Sb^) with K = [K'Y /5 

at|«(i)|'+7l«l' <4i^||mi||2|«|2 . 
Thus, using the comparison principle, 

k(t)|' < k(s)pexp( A4i^||mif-7]dr). 

J s 

This converges to exponentially fast, provided 7 is sufficiently large, as v{s) = 
TOq^'' — fh'^\ Moreover, 

|^(^)|2g2^(t-.) < \v{s)\^e^p{{t-s)r{t,s)). 

with r{t,s) — J*[4:K\\mi\\^dT — 7 + 277 and limsups_5.„o2 r(i, s) < by 
assumption. This implies the claim of the theorem. □ 



6 Numerical Results 

In this section we study the SPDE (21) by means of numerical experiments, 
illustrating the results of the previous sections. We invoke a split-step scheme 
to solve equation (21), in which we compose numerical integration of the Navier- 
Stokes equation (18) with numerical solution of the Ornstein-Uhlenbeck process 

^+uA-^''{m-u)=uaoA-^^-^^, m{0) ^ m„, (43) 
at at 

at each step. The Navier-Stokes equation (18) itself is solved by a pseudo- 
spectral method based on the Fourier basis defined through (17), whilst the 
Ornstein-Uhlenbeck process is approximated by the Euler-Maruyama scheme 
[24]. All the examples concern the case A = 00 only; however similar results are 
obtained for finite, but sufficiently large, A. 



21 



6.1 Forward Accuracy 

In this section, we will illustrate the results of Theorem 4.3. We will let a = 
1/2 throughout; since /3 is always non- negative the trace-class noise condition 
4a + 2/3 > 1 is always satisfied. Notice that the parameter w sets a time-scale for 
relaxation towards the true signal, and (Jq sets a scale for the size of fluctuations 
about the true signal. The parameter P rescales the fluctuation size in the 
observational noise at different wavevectors with respect to the relaxation time. 
First we consider setting /3 — 0. In Fig. 1 we show numerical experiments with 
w = 100 and tJo = 0.05. We see that the noise level on top of the signal in the 
low modes is almost 0(1), and that the high modes do not synchronize at all; 
the total error remains 0(1) although trends in the signal are followed. On the 
other hand, for the smaller value of ctq = 0.005, still with oj = 100, the noise 
level on the signal in the low modes is moderate, the high modes synchronize 
sufficiently well, and the total error is small; this is shown in Fig. 2. 

Now we consider the case /3 = 1. Again we take oj = 100 and Co — 0-05 
and 0.005 in Figures 3 and 4, respectively. The synchronization is stronger than 
that observed for (3 — in each case. This is because the forcing noise decays 
more rapidly for large wavevectors when /3 is increased, as can be observed in 
the relatively smooth trajectories of the high modes of the estimator. 

For the case when ctq = we recover a (non-stochastic) PDE for the esti- 
mator m. The values of ctq and (3 are irrelevant. The value of w is the critical 
parameter in this case. For values of ui of O(IOO) the convergence is exponen- 
tially fast to machine precision. For values of u of 0(1) the estimator does not 
exhibit stable behaviour. For intermediate values, the estimator may approach 
the signal and remain bounded and still an 0(1) distance away (see the case 
cj = 10 in Fig. 5), or else it may come close to synchronizing (see the case 
cj = 30 in Fig. 6). 

6.2 Forward Stability 

This section will provide numerical evidence supporting Theorem 4.5. In order 
to investigate the stability of estimators we reproduce ensembles of solutions of 
equation (21), for a fixed realization of W{t), and a family of initial conditions. 
We let f3 — throughout this section, and we always choose values of a which 
ensure that the trace class condition on the noise, 4a -I- 2/3 > 1, is satisfied. 

Let m'^'"'^ (t) be the solution at time t of (21) where the initial conditions are 
drawn from a Gaussian whose covariance is proportional to the model covari- 
ance: m^'^)(0) ~ A/'(0, 30^6*). First we consider a = 1/2. Figure 7 corresponds 
to parameters given in Fig. 1 of section C.l. The top figure simply shows 
the ensemble of trajectories, while the bottom figure shows the convergence of 
\m^'^\t) — m^^\t) \ /\m^^^ {t)\ for fc > 1. Notice the trajectories converge to each 
other, indicating stability. But, the trajectories here do not converge to the 
truth (or driving signal). This is because the neighbourhood of the signal which 
bounds the estimators is not small. The next image. Fig. 8, shows results for 
the smaller value of CTq — 0.005 corresponding to Fig. 2 of section 6.1. Notice 
the rate of convergence of the trajectories to each other (bottom) is very similar 
to the previous case, indicating that there is again stability. However, this time 
the neighbourhood of the signal which bounds the estimators is small, and so 
they are indeed accurate. Fig. 9 shows the results for the larger value of a = 1 
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Figure 1: Trajectories of various modes of the estimator fh and the signal u are 
depicted above for /3 = and o-g = 0.05, along with the total relative error in 
the norm, |m — 





0.1 



-0.1 



-0.2 





10 



-|m(t)-u(t)|/|u(t)| 



1 0"' \0>l/(i)0*^^ 



10 



20 40 60 80 

t 



Figure 2: Trajectories of various modes of the estimator fh and the signal u are 
depicted above for ^ = and ctq = 0.005, along with the relative error in the 
norm, |m — it|/|M|. 
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Figure 5: Trajectories of various modes of the estimator fh and the signal u are 
depicted above for ~ and u ~ 10, along with the relative error in the 
norm, |m — 



(still with f3 — 0). In this case, there is no stability, i.e. the trajectories do not 
converge to each other (bottom), and also no convergence to the truth (bottom 
right of the top panels), although all trajectories do remain in a neighbourhood 
of the truth and the low wavevector modes converge (top left), so there is ac- 
curacy with a large bound. Furthermore, the distance of the trajectories from 
each other is similar to the distance from the truth, so the attractor in this case 
may be similar to the attractor of the underlying Navier-Stokes equation. 

6.3 Fullback Accuracy and Stability 

Finally, in this section, we illustrate Theorem 5.7. As the subtle nuance dif- 
ferences between forward and pullback accuracy and stability ellude standard 
numerical simulation, we do not feel it is appropriate to explore this in further 
detail numerically. So, this section will be brief. We include a single image 
illustrating the equivalence of the above experiments in Figures 8, 7, and 9 to 
the traditional notion of pullback attractor in the case that the attractor is a 
point: Figure 10. 

7 Conclusions 

Data assimilation is important in a range of physical applications where it is of 
interest to use data to improve output from computational models. Analysis of 
the various algorithms used in practice is in its infancy. The work herein con- 
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Figure 6: Trajectories of various modes of the estimator fh and the signal u are 
depicted above for do = and uj ~ 30, along with the relative error in the 
norm, |m — 



tains analysis of an algorithm, 3DVAR, which is prototypical of more complex 
Gaussian approximations that are widely used in applications. In particular we 
have studied the high frequency in time observation limit of 3DVAR, leading 
to a stochastic PDE. We have demonstrated mathematically how variance in- 
flation, widely used by practitioners, stabilizes, and makes accurate, this filter, 
complementing the theory in [ ] which concerns low frequency in time obser- 
vations. It is to be expected that the analytical tools developed here and in 
[5] can be built upon to study more complex algorithms, such as the extended 
and ensemble Kalman filters, variants on which are used in operational weather 
forecasting. This will form a focus of our future work. 
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